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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students' proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Arizona, 2,651 students in 104 
public schools were assessed. This report describes the reading proficiency 
of Arizona fourth-graders and compares their overall performance to students 
in the West region of the United States and the nation (using data from the 
NAEP national assessments) . The distribution of reading results and reading 
achievement level results are provided for subpopulations of students 
(race/ethnicity, type of location, parents, educational level, and gender) . 
Reading proficiency and achievement of non-public school students are 
separately reported and compared to public school students. To provide a 
context for the assessment data, participating public school students, their 
reading teachers, and principals completed questionnaires which focused on: 
policies and practices related to reading (time for instructional activities 
and instructional resources for reading) ; delivery of reading instruction 
(instructional materials and activities, workbooks/ worksheets/writing, 
discussion and group activities, time to read, reading and use of libraries, 
assessing progress in reading) ; reading instructors (preparation, experience 
and professional development); students' home support for literacy (reading 
outside of school and in the home and hours of television watched per day) . 
The average reading proficiency of public school students in Arizona on the 
NAEP reading scale was 206 compared to 212 nationwide. (CR) 
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What is The Nation’s Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing 
assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in 
reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student performance available to 
policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. 
Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of individual students and their 
families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified organiza- 
tions. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies and 
solicitation of public comment, on NAEP’s conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate student 
performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking 
actions to improve the form and use of the National Assessment. 
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EXECUTIVE 

SUMMARY 



In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics.' The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories.^ 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment progrmn in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in Febmary 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
public school students in Arizona, the West region, and the nation. The distribution of 
reading proficiency results and reading achievement level results are provided for groups 
of students defined by shared characteristics: race/ethrucity, type of location, parents’ 
education level, and gender. Contextual information about reading policies, instruction, 
and home support for reading is presented for public school students. State results are 
based on the representative sample of students who participated in the 1994 Trial State 
Reading Assessment Program. Results for the region and the nation are based on the 
regional and national representative samples of students who participated in the national 
NAEP assessmen t. 

For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP*s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

2 

For a summary of the 1992 assessment of re adin g, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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School and Student Participation in the Reading Assessment 

In Arizona, 104 public schools participated in the 1994 fourth-grade reading 
assessment. This number includes participating substitute schools that were selected to 
replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1994 was 99 percent for public schools, 
which means that the fourth-grade students in this sample were directly representative 
of 99 percent of all the fourth-grade public school students in Arizona. 

In Arizona, 2,651 public school fourth-grade students were assessed in 1994. The 
weighted student participation rate was 94 percent for public schools. This means that 
the sample of fourth-grade students who took part in the assessment was directly 
representative of 94 percent of the eligible public school student population in 
participating schools in Arizona (that is, all students from the population represented 
by the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 93 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 93 percent of the eligible fourth-grade public 
school population in Arizona. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Arizona. However, these nonparticipation adjustments 
may not adequately compensate for the missing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Arizona failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Arizona met all established NCES participation rate guidelines for public 
schools. 
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Students^ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Arizona, the West region, and the nation. 

1994y Public School Students 

The average reading proficiency of fourth-grade public school students 
in Arizona on the NAEP reading scale was 206. This average was lower 
than that of students across the nation (212).^ The lowest performing 
10 percent of public school fourth graders in Arizona had proficiencies 
at or below 148 while the top 10 percent had proficiencies at or above 
259. In public schools across the nation, the lowest performing 10 
percent of fourth graders had proficiencies at or below 156; the top 
performing 10 percent of students had proficiencies at or above 261. 

1992 vs 1994 y Public School Students 
There was no significant change in the average performance of 
fourth-grade public school students in Arizona from 1992 to 1994 (209 
in 1992 and 206 in 1994). During the same period, there was no 
significant change in the average performance of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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1992 

Arizona 

West 

Nation 

1994 

Arizona 

West 

Nation 



Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table below provides 
results for Anzona, the West region, and the nation according to each reading purpose. 

1994y Public School Students 

The proficiency of public school students in Arizona in reading for 
literary experience (210) was lower than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Arizona (202) was lower than that of 
students across the nation (210). 

1992 vs 1994y Public School Students 
Arizona’s public school fourth graders showed no significant change 
from 1992 to 1994 in reading for literary experience. Similarly, in 
reading to gain information, public school fourth graders in Arizona 
exhibited no significant change from 1992 to 1994. 
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Reading 



1994 Trial State Assessment 



Reading for Literary Experience 
1992 Public 
Arizona 
West 
Nation 
1994 Public 
Arizona 
West 
Nation 

Reading to Gain Information 
1992 Public 
Arizona 
West 
Nation 
1994 Public 
Arizona 
West 
Nation 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 




The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. 
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Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given below. Chapter 3 provides further elaboration of these 
levels and presents examples of types of questions that students at each of the three 
achievement levels can respond to effectively. 
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Description of Fourth-Grade Reading Achievement 
Levels 



Achievement 

Level 


Scale 

Outpoint 


Description 




268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 




238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 




208 


Fourth-grade students performing at the Basic /eve/ should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Arizona who were at or 
above the Proficient level (24 percent) was somewhat lower than that 
of students across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Arizona who attained the Proficient level 
(21 percent in 1992 and 24 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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Levels of Fourth-Grade Public School Students’ 
Reading Achievement 



1994 Trial Sts 


ita Assessn 


lent 




At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 








The Standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students."^ The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 
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Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Qaudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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Race/Ethnicity 

1994, Public School Students. The average reading proficiency of White 
students in Arizona public schools was higher than that of Black, 
Hispanic, and American Indian students. 

7992 vs 1994, Public School Students. There was a decrease in the 
average reading proficiency of Hispanic public school students in 
Arizona from 1992 to 1994. There was no significant change in the 
average reading proficiency of White, Black, or American Indian public 
school students in Arizona from 1992 to 1994. 

Type of Location 

1994, Public School Students. The average reading proficiency of 
Arizona students attending public schools in central cities was not 
significantly different from that of students in urban fringe/large towns 
and rural areas/small towns. 

7992 vs 1994, Public School Students. From 1992 to 1994, there was 
no significant change in the average reading proficiency of students 
attending public schools in central cities, urban fringe/large towns, or 
rural areas/small towns in Arizona. 

Parents^ Education Level 

1994, Public School Students. Public school students in Arizona 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which did not differ significantly from 
that of students who reported that at least one parent had some education 
after high school but was higher than that of students who reported that 
at least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

7992 vs 1994, Public School Students. The average proficiency of public 
school students in Arizona who reported that at least one parent 
graduated from college, at least one parent had some education after 
high school, at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ 
education level did not change significantly between 1992 and 1994. 

Gender 

1994, Public School Students. In public schools in Arizona, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 

7992 vs 1994, Public School Students. In Arizona public schools, the 
average reading proficiency for boys did not change significantly from 
1992 to 1994. Similarly, the average proficiency for girls did not change 
significantly from 1992 to 1994. 
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